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ROBOT CONTROL METHODS AND 
APPARATUS 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to the civilian or industrial 
use of robots, more particularly to methods and an apparatus 
for the control of the pattern of action of a robot. 

2. Description of the Related Art 

When teaching action to a robot, it had been necessary to 
first program all of the desired patterns of action and their 
order and then store them in the robot or a control apparatus 
of the robot. When the actions are determined by a program, 
a robot operates exactly according to the patterns of action 
described in the program. Accordingly* it was not possible to 
make the actions of the robot more diverse and there were 
limits to what could be expressed by the actions of the robot 
The expressability could not have been said to be adequate. 

Recently, as a system for control enabling the actions of 
a robot to be changed in accordance with the dianging 
dynamic environment around it, the system of subsumption 
ardiitecture for layered control of basic actions such as 
avoidance and evasion of obstructions has been proposed 
(Rodney A. Brooks, **A Robust Layered Control System for 
A Mobile Robot**, IEEE Journal of Robotics and 
Automation, vol RA-2, no. 1, March 1986). 

According to this system^ when the actions belonging to 
the higho: layer are not suitable for the surrounding envi- 
ronment and end in failure, the robot is constantly guided to 
take action belonging to the lower layer. When conversely 
the action belonging to the lower layer failed, however, it 
was dif&cult to positively guide the robot to take action 
belonging to the higher layer. 

Further, according to the subsumption architecture 
system, patterns of action were given by superposition of 
layered actions. Since however the patterns of actions con- 
tained in eadi layer were fixed, limitations again ended up 
being placed on the diversity of the patterns of action. 

In this way, even in the subsumption architecture systena, 
over-simplification of the patterns of action of the robot 
could not be avoided and there were limits to the express- 
ability of the operations of the robot itself. 

SUMMARY OF THE INVENTION 

The present invention was made in consideration of the 
above problems in the related art and has as its objea to 
provide methods and an ^paratus for the control of the 
actions of a robot which enable the operations of the robot 
to be made more diversified, the matter expressable by the 
operations inaeased, and further the expressabiHty of the 
operations of the robot enhanced. 

Accordingly to one aspect of the present invention, there 
is provided a robot control method for controlling the 
operation of a robot so as to pass through a plurality of states 
corresponding to a predetermined operation, comprising 
determining at least one operational arc between two 
directly passable states among the plurality of states show- 
ing the operation of the robot when passing between the two 
states, giving to each of the determined operational arcs a 
weighting coefficient corresponding to the probability of that 
operational arc being selected, selecting based on probabil- 
ity one of the operational arcs between the two states when 
making the operation of the robot pass between the two 
states based on the weighting coefELclents of the operational 
arcs between the two states, and controlling the robot so as 
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to perform the operation shown by the selected operational 
arc when making the operation of the robot pass between the 
two states. 

Preferably, when making the operation of the robot pass 
between two or more states among the plurality of states, the 
operational arcs are selected between each two directly 
passable states among the two or more states so that the sum 
of the weighting codKcients becomes smallest. 
Preferably, the operational arc includes a self operational 

) arc showing the operation of the robot when returning firom 
one state among the plurality of states to the same one state. 

According to another aspect of the invention, there is 
provided a robot control method for controlling the opera- 
tion of a robot so as to pass through a plurality of slates 

. corresponding to a predetennined operation, comprising a 
step of receiving a starting operating state and a target 
operating state of the robot and a step of selecting a path 
giving the smallest sum of weighting coefficients when 
passing firom the starting state to the target state based on a 

J predetermined status transition chart having a plurality of 
states and given weighting coefficients showing the ease of 
passage between states. 

Preferably, at least one operational arc is defined between 
each two states, when there are a plurality of operational arcs 

^ between two states, each of those operational arcs is given 
a probability of passage showing the chance of passage, and 
one of the plurality of operational arcs between the two 
states is selected in accordance with the probability of 
passage. 

) According to still another aspect of the invention, there is 
provided a robot control apparatus for controlling the opera- 
tion of a robot having a plurality of states conrcsponding to 
a predetermined operation, at least one operational arc being 
determined between each of any two directly passable states 

^ among the plurality of states showing the operation of the 
robot when passing between the two states, comprising a 
weighting means for giving to each of the determined 
operational arcs a weighting coefficient corresponding to the 
probability of that operational arc being selected, an opera- 

3 tional arc selecting means for selecting based on probability 
one of the operational arcs between the two states when 
making the operation of the robot pass between the two 
states based on the weighting coefficients of the arcs of 
operation between the two states, an operating data produc- 

5 ing m^ans for producing along with time operating data 
corresponding to the operation of the robot shown by the 
selected operational arc, and controlling means for control- 
ling the operation of the robot based on the produced 
operating data. 

0 Preferably, the operational arc includes a self operational 
arc showing the operation of the robot when returning from 
one state among the plurality of states to the same one state 
and the operating data producing means suppresses the 
production of the operating data corresponding to the self 

5 operational arc before the transition in states and after the 
transition in states when the states of the robot before the 
transition of states and after the transition of states coincide. 

In the methods and apparatus for control of a robot 
according to the present invention, the states corresponding 

0 to basic operations of the robot such as **walking", "sitting", 
and "standing", the operational arcs showing the operations 
when the robot passes between two states, the self opera- 
tional arcs showing the operations for a transitioa in state 
within the same state, and weighting coefficients given to 

5 these operational arcs etc. are defined. 

The methods and apparatus for controlling a robot accord- 
ing to the present invention define one or more of the 
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operations when passing between two states directly pass- 
able without the intervention of another state between them 
among these states and select based on probability the 
operation for passing between these two states for control of 
the operation of the robot so as to thereby give change to the 
operations of the robot and inaease the expressability of the 
robot. 

In the robot control apparatus according to the present 
invention, the operational arc selecting means selects based 
on probability one among the plurality of selectable opera- 
tional arcs for passing between two directly passable states 
based on weighting coefScients. 

Further, when passing through two or more states from a 
state at the time of start of the operation to the state at the 
time of end of the operation* the operational arc selecting 
means selects the operational arcs giving the smallest sum of 
the weighting coefBdents of the operational arcs linking two 
states among these states. 

The operating data generating means generates along with 
time the operating data for realizing the movement of the 
robot shown by the operational arc corresponding to each of 
the selected operational arcs. 

The controlling means controls the rotation etc, of the 
motors driving the robot based on the generated operating 
data, makes the robot perfonn the qjerations shown by the 
selected operating data, successively executes the status 
transitions, and thereby realizes a predetermined action of 
the robot. 

BRIEF DESCRIFnON OF THE DRAWINGS 

These and other objects and features of the invention will 
become clearer from the following description of the pre- 
ferred embodiments given with reference to the attached 
drawings, in which: 

FIG. lA, HG. IB, and FIG. IC are views showing the 
external shape of a robot to which the robot control method 
according to the present invention is applied, in which FIG. 
lA is a front view of the robot FIG. IB is a top plane view 
of the robot and FIG. IC is a side view of the robot; 

FIG. 2 is a view of the configuration of the control portion 
used for realizing the robot control method according to the 
present invention in the robot shown in FIG. 1; 

FIG. 3 is a view of the configuration of a program for 
realizing the robot control method according to the present 
invention; 

FIG. 4 is a view of the status transition chart showing the 
relationship among the states, operational arcs, and weight- 
ing coefiBcients of the robot shown in RG. 1; 

FIG. 5 is a view showing N number of operational arcs 
defined between two states positioned adjoining each other 
in FIG. 4 and able to be directiy passed between without the 
intervention of another state; 

FIG. 6 is a flow chart of the processing of the path 
selection portion shown in FIG. 3; 

FIG. 7 is a view showing an exan^lc of the path search. 

FIG. 8 is a status transition chart giving weighting coef- 
ficients to the status transition chart shown in FIG. 4, 
specifying the state 3 as the starting state, and specifying the 
state 4 as the target state; and 

FIG. 9 is a view of the operational arcs determined by the 
status transition preparation portion, path selection portion, 
arc selection portion, and data transmission portion shown in 
HG.3. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 
Preferred embodiments of the present invention will be 
explained below. 
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FIG. lA, FIG. IB, and HG. IC are views showing the 
external shape of a robot to which the robot control method 
according to the present invention is applied, in which FIG. 
lA is a front view of the robot, FIG. IB is a top plane view 

5 of tiie robot and FIG. IC is a side view of the robot. 
As shown in FIGS. lA to IC, tiie robot 1 has four legs lOa 
to lOd which are driven controlled by the robot control 
methods according to the present invention. The basic 
operations of the robot 1 called "sleeping (state 1)", "sitting 

10 (state 2)", **waving (state 3)", "standing (state 4"), and 
'^walking (state 5)" are defined here as the "states** (FIG. 4 
etc.). Further, when passing between such states, the robot I 
operates based on "operational arcs" which are defined in 
advance, are given weighting coefficients corresponding to 

15 the probabilities of being selected, are selected based on the 
probabilities, and define q)erations of the robot 1 when 
passing between these states. 

FIG. 2 is a view of tiie configuration of the control portion 
used for realizing the robot control method according to the 
^ present invention in the robot shown in FIG. 1. 

As shown in FIG. 2, the control portion 12 of the robot 1 
is compised of a control circuit 14, drive portions 120^i to 
120^, and a sensor 16. 

25 The control circuit 14 is comprised of a microprocessor, 
ROM, RAM, and peripheral circuits required for computa- 
tions. It executes the program (FIG. 3) for realizing the robot 
control method according to the present invention and 
supplies operating data showing the movement of the legs 

30 10a to li^b to the drive portions 120^? to 129d based on tiie 
data defining the preset states and the sensor data etc, input 
from the sensor 16. 

The sensor 16 detects for example the environment sur- 
rounding the robot 1, such as the intensity or color of tiie 
35 light or temperature and the distance to the walls surround- 
ing it or other robots 1, and outputs the sensor data con- 
cerning the surrounding environment detected to the control 
circuit 14. 

The drive portions 120a to I2^d are comprised of motors, 
40 motoc drive circuits, etc. and move the legs 10a to lOd back 
and forth and up and down based on the operating data input 
from the control circuit 14. That is, the control circuit 14 and 
drive portions 120a to 120^ operate in conjunction and 
realize the operation of the robot 1 in different states and tiie 
45 operation of the robot during the transition between states. 
FIG. 3 is a view of the configuration of a program for 
realizing the robot control metiiod according to the present 
invention. 

The status transition preparation portion 140, path selec- 
tion portion 142, arc selection portion 144, and data trans- 
mission portion 146 shown in FIG. 3 are stored in tiie ROM 
of the conntrol circuit 14 and are executed by the micro- 
processor of the control circuit 14. 

Operation of Status Transition Preparation Portion 
140 

The status transition preparation portion 140 sets the 
states passed tiirough from the state at the start of the 
60 operation of tiie robot 1 (starting state) to tiie state at tiie end 
of the operation (target state) and {arepares a status transition 
chart (HG. 4 etc.) based on the set states and tiie operational 
arcs at tiie time of transition between states. 

First, it defines in advance tiie states to be realized by the 
65 robot 1 and defines one or more operational arcs showing the 
operation of the robot 1 at the time of transition between 
states between each two directly passable states so as to 
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inake Ihe robot 1 pass direcUy between the defined states. It The path selection portion 142 selects the optimal opera- 
gives to each of these defined operational arcs a weighting tionai path when setting the robot 1 from the starting stale S 
cc>efficient cwesponding to the probability of U being to the target state S„ based on the status transiUon dia^ 
selected by the arc selecting portion 144. shown in FIG. 4. An "operational path" is defined as a series 
The sutes and operational arcs defined above can be 5 of operational arcs which starts from the starting state and 
expressed in a status transition chart. That is, the operational can reach the target state through directly connected 
arcs A,^ for dianging the oparation of the robot 1 from the operational arcs. There are generally a plurality of opera- 
state S, to the state Sj are defined for the two defined states tionai paths. The path giving the smallest evaluation func- 
S, and Sj. tion W shown by the following equations is selected. 

The operational arcs Ay are given the weighting coefS- 
dents w,^. The operational arcs A,^ included in the final ism Wi (2) 



operational path can be seleaed from N number of opera- 
tional arcs A\j (k=l N). The probable weight 



1 



{^=1 N) of an operational arc A*^ being seleaed is 

shown by the foUowing formula: i5 w^^zw^- 



1= I /** (1) 

*=i. • • t ^ Here, shows the sum of the weighting coefficients of 

TTrr' A ' ■ j: ... . operational arcs conmrising the path 1 able to lead from 

FIG. 4 is a view of a status transition chart showing the the starting state to the target state S,. Further, m, shows 

relauonship among the states, operational arcs, and weight- the number of the operational arcs A., comprising this path 

mg coefficients of the robot 1. Note that HG. 4 shows single (i, 2 M, 5). In the above ^Va^M^hows^e 

operation^arcs but fficse may be multiple arcs as weU as total number of states S, of the status tLsition chart shown 

shown in FIG. 5. In this case, equauon 1 is satisfied. pjQ^ 4^ 

For example, as shown in HG. 4 the weighting ooeffi- 25 Below,' an explanation wiU be made of the deiaUed 

frf tJ^'/.TV' ""^T"^ '^^T'^'iT. Pro^^^^i^S means for selecting a path, 

from the state 1 where the robot 1 retracts its legs 10a to lOii i^- . * u • • . • 

under it and places its bottom down on the floor (sleeping) , ^^""^^^ managmg the 

to the state 2 where the robot 1 retracts its legs 10a and lol, ^ "^^^^^ ^ ^^^^ ^^^^^ 

extends its legs lOc and liki, and places just its bottom at the 30 starting group of the closed list is an empty group. As 

side of the legs l©c and mi down on the floor (sitting). starting group of the open list, all states S. (i=l M) 

Further, the weighting coefficient w,4 is given to the ^^^^ ^^^^ ^ following equations: 

(Rational arc for the transition from the state 1 (sleeping) closed iist=4> 
to the state 4 where the robot 1 extends its legs 10a to 10</ 

and maintains its bottom parallel to the floor (standing). 35 ^H^u Sj, . . . » s«} (4) 

Further, the weighting coefficient w^^ is given to the opera- Further, as shown by the foUowing equation, the evalu- 

ttona^ arc for the transiuon from the state 2 to the state 1. ation variables Dli] corresponding to the states S, are 

Operational arcs are defined m the same way between the defined as the initial values of the evaluation variables, 
states 1 , 2, and 4 and the other two states [state 3 where the 
robot 1 alternately extends and retracts its legs lOia and 106 40 

and legs 10c and lOi^ (waving) and state 5 where the robot D[i] 
I walks (walking)] and are given the weighting coefficients 

. . . , W55 . Further, as shown by the following equation, the starting 

FIG. 5 shows N number of operational arcs defined state is made the starting connected state S . 

between two states positioned adjoining each other in FIG. ^ 
4 and able to be directly passed between without the 

intervention of another state. That is, for exanqjle, it shows Next, the open list group, closed list group, evaluation 

a plurality of operational arcs even for the case of transition variables, and connected states are updated 

in state from "sleeping*- to "sitting^ Using the equations (7-1) and (7-2) in the foUowing 

As shown in FIG. 5, there arc N number of operational equations, the open list group, closed list group, evaluation 

arcs Ai2 dtfincd between the state 1 and state 2, The variables, and connected state are repeatedly updated untU 

probabiUties of these N number of operational arcs A^j %=So* 
being selected by the arc selection portion 144 are given by 

the probable weights P(l) to P(N). (7-i) 

r 1 . ^ . , 55 mia /)i4Sie open list 

Operauon of Path SelecUon PorUon 142 s, 
The path selection portion 142 selects a group of opera- 
tional arc^ giving the smaUest sum of the weighting coef- du\=^ iDiiiDip\^^(S,s.is^cV.so^Ust 
naents of the operational arcs ucluded in an operational s, 

path based on the status transition chart prepared by the 60 „ ^. „ . ^ . . _ . . 

status transition preparation portion 140 as the operational ""^^ ^' satisfying equaUon (7-1) is updated to 

path through which the robot 1 passes from the starting slate connected state Sp as the new connected sute S^. This 

to the target state. That is, there may be one a more connected state is removed from the open list group 

operationalarcsbetweenanytwodiiectlypassableadjoining '""^ "'^^ *| ""^T*^ S^°"P- 

states included in the operational path. For example, there 65 '''''^^^ (OLD) becomes the parent of the new 

are more than one operaUonal arcs for the traasiUon from "connected state (NEW) and is connected by the pointer. 

"sleeping" to "sitting". s,(OU))*-s/NEW) («) 



< = a,iiulial stale 
othowise 
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The evaluation variables D[i] are updated by equation 
(7-2) through this new connected state S . 

Further, the pointer is followed in the closed list from the 
target state to obtain the series 1 of statcs^S^ S,, . . . 

S, leading to the starting state At this time, the 

operational path from the starting state to the target state 
Sa of the robot is found from the following equation by 
following the pointer in the closed list in reverse. 

Ao.ii-*Ai,.i,->Aij.|j-yAt2.ij^. . . -*A|^,.i^j-+Ai^^.o (9) 

As explained above, with the exception of the starting 
state the A, , corresponding to the state S, through which 
the operational path passes is always selected 

FIG. 6 is a flow chart of the processing of the path 
selection portion 142. 

As shown in FIG. 6, the path selection portion 142 as an 
initial setting makes the open list group (OPEN) all of the 
states and makes the closed list group (CXOSED) empty 
(SI). Further, it makes the starting connected state (S2). 

If the target state and the connected state match, the target 
state has already been reached, so the search of the state is 
ended (S3). 

The pointer is followed in the closed list group from the 
target state to the starting state to resort from the starting 
state to the target state in reverse (S7). 
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Step SI corresponds to S5, S6. S3, and S4 in the flow of 
FIG. 6. First, the smaUer of D[Sil and D[Sp]+W[Sp,Si] is 
selected from the open list and changed to the new D[Sil, 
Further, the Si giving the smallest D[Si] for this new D[Si] 

^ is found. From the table, D[S3J =1 is the smallest, so S^ is 
made S3 and T>lSp] is made 1, S3 is moved from the open 
list to the closed list, and the routine proceeds to the next 
step. The candidate for the path to the smallest D[S5] at this 

10 point of time has not yet been found. 

Step S2 updates D[Si] in a similar manner. If the smallest 
is selected, D[S4]=3 is the smallest in the table. S^ is made 
S4 and D[Sp] is made 3, then S4 is moved from the open list 
15 to the closed list and the routine proceeds to the next step. 
S2-S3-S5 is found as the candidate for the path to the 
smallest D[S5] at this point of time. 

At step S3, DfS5] becomes the smallest. Since S5 is the 
20 target, the search ends here. That is, the path of S2-S3-S5 is 
found. 

The table gives the next steps. Next, SI is the smallest 



Step Closed 


Open 


Sp 




DlSl] 


D[S2] 


D(S3] 


D[S4] 


D(S5} 


mii^ D[Si] 


pass to S5 


0 


1> 2, 3, 4, 5 


2 


0 




0 


oo 


oo 


oo 


2 


* 


1 2 


1,3,4,5 


2 


0 


10 


m 


1 


5 




3 


* 


2 2, 3 


1.4,5 


3 


1 


1+4 


* 


♦ 


1 + 2 


1 + 2 


4 


2-3-5 


3 2, 3, 4 


1. 5 


4 


3 


5 




* 


* 


3 


5 


2-3-5 


4 2, 3, 4, 5 


1 


5 


3 


5 


« 


* 


* 


« 


1 





Due to the above processing, the series of operational arcs Operation of Arc Selection Portion 144 

^r/eSi?n'^^^^ The arc selection portion 144 selects based on probabiHty 

^^^thit^i^.^^^ ... . one of the operational arcs included in the operational path 

. tl^^vS^fw^^^^^^ T "^^^^v t ^^1^^^ by flie path selection portion 142based on the 

state givmg the smallest evalumion variable in the optn hst weighting coeffidents given to thVoperational arcs. TTiat is, 

TTieevalStionvarkblesintheopenlistareupdatedusing ^V^^^^^ ^^^^ 

the new connected state S^ (S5).^ ^ ^ SSonTplS^^ '''' 

Further, the connected state S_ is added from the open list ^ cf^„ %aa i^u a t.!.-,*. 

to the closed Hst and the processfng of S3 is returned to (S6). arc selection portion 144 selects based on probability 

Note that the processing of S4 fo S6 is repeated untU the T T'T'^t ^"""^ operaUonal arcs A^, 

conditions of S3 are satisfied. ^5 which each of Oie o^raUonal arcs A,, m the operational path 

Next, an explanation wiU be added regarding the path ^^^lude a plurahty of for the operational path selected by the 
seardi in a graph giving a specific example based on the flow selection pomon 142. 

of HG. 6. However, for reasons of the table and convenience example, when there are three operational arcs able to 

in explanation, the order of "S4'* and '*S5" is switched from selected from and their probabilities are 5/8. 2/8, and 1/8, 

the flow of FIG. 6. Due to the switch, the evaluation of min so when the selection {H-ocessmg is performed eight times these 
D[Si] is **S5'' and a new D[Si] is changed to, but since the ^^^^^^ ^« respectively, 

starting state is set to S^ at the initial stage, at the first "S4" processing routine of the selection first considers 

the processing is just for resetting D[Sp] to 0, so the uniform random numbers in the range of the numerical 

processing is equivalent. This method is a widely known values [Rq, R J and defines the region fs^^. tf,\ corresponding 
search method called the Dijkstra method. 55 the operational arc A*y by the following equation. 

Next, a graph of the weighting such as shown in FIG. 7 
is considered and a path search is conducted starting from S2 [ Jt-i Jt 1 f^^) 

and ending at S5. - ^0) p"- - ^0) 2: 

Step SO corresponds to SI, S2, S3, and S4 in the flow of L ^ 

FIG. 6. Here, the closed list is eir^)ty and the open list 60 Here, in the above quation. P* shows the probability 

contains all of 1, 2, 3, 4, and 5. Here, Sp=2 is selected, coefficient and 1^=0. 

everything except for D[S21 is made 00, and D[S2] is set to When the value v of the unifoorm random number is in 

0. The Si with the smallest value of D[Si] in this state is the range of %^^y<^,,. the operational arc A*^ corresponding 

sought As shown in the table, D[S2] is the smallest S^=S2 to the value v of the uniform random number is selected, 
is selected again, D|Sp| is nude 0, S2 is moved from the 65 By this selection, the operational path from the starting 

open list to the closed list then the routine proceeds to the state S, to the target state S^ of the robot is defined by the 

next step. following equation using the selected operational arc A*y. 



